Incorporating Efficiency in Evaluation
نویسندگان
چکیده
The trade-off between retrieval efficiency and effectiveness naturally arises in various domains of information retrieval research. In this paper, we argue that the users’ reaction to the system efficiency should be incorporated into the cascade model of the user behaviour and that an effectiveness-aware modification of a state-of-the-art evaluation metric can be derived. We propose to base the study on the anonymised browser/toolbar log data, and our preliminary experiments demonstrate that the users’ reaction to the delays observed in the dataset is consistent with one reported previously.
منابع مشابه
Incorporating Cost-Effectiveness Data in a Fair Process for Priority Setting Efforts; Comment on “Use of Cost-Effectiveness Data in Priority Setting Decisions: Experiences from the National Guidelines for Heart Diseases in Sweden”
Cost-effectiveness data is useful for use in priority setting decisions in order to improve the efficiency of resources used. This paper thereby responds to Eckard et al. which addressed the use of cost-effectiveness data in the actual prioritization decisions in the Swedish national clinical guidelines for heart diseases. Based on a set of experiences on the use of economic evaluation in prior...
متن کاملInfluences of Device Architectures on Characteristics of Organic Light-Emitting Devices Incorporating Ambipolar Blue-Emitting Ter(9,9-diarylfluorenes)
In this article, we report the studies of various device architectures of organic lightemitting devices (OLEDs) incorporating highly efficient blue-emitting and ambipolar carriertransport ter(9,9-diarylfluorene)s, and their influences on device characteristics. The device structures investigated include single-layer devices and multilayer heterostructure devices employing the terfluorene as one...
متن کاملA Value Efficiency-Based Target Setting Approach in Data Envelopment Analysis
Basic models of Data Envelopment Analysis are intrinsically preference-free, in the sense that they consider all inputs and outputs and also all decision making units of the same importance. Although this property is beneficial in many ways, it has some drawbacks simultaneously, as the decision makers’ preferences are not taken into account in the process of evaluating units. To overcome this ...
متن کاملComplete Closest-Target Based Directional FDH Measures of Efficiency in DEA
In this paper, we aim to overcome three major shortcomings of the FDH (Free Disposal Hull) directional distance function through developing two new, named Linear and Fractional CDFDH, complete FDH measures of efficiency. To accomplish this, we integrate the concepts of similarity and FDH directional distance function. We prove that the proposed measures are translation invariant and unit invari...
متن کاملAn improved approach for ranking the candidates in a voting system based on efficiency intervals
This paper proposes improvements and revisions to a recent approach in a voting system, and provides an effective approach with a stronger discriminate power. For this purpose, the advantage of a linear transformation is utilized to redene a previously used concept of virtual worst candidate, by incorporating the existing weight restrictions. Then, the best score of this virtual candidate is us...
متن کاملA Multi-Year Scenario-Based Transmission Expansion Planning Model Incorporating Available Transfer Capability
This paper presents a multi-year scenario-based methodology for transmission expansion planning (TEP) in order to enhance the available transfer capability (ATC). The ATC is an important factor for all players of electricity market who participate in power transaction activities and can support the competition and nondiscriminatory access to transmission lines among all market participants. The...
متن کامل